2024-07-12 20:45:58,455 INFO     ##### CIs for documents that mention Trump #####
2024-07-12 20:46:10,209 INFO     GPT-4 No Logit Bias
2024-07-12 20:46:10,210 INFO     MCC: 0.781653528458052
2024-07-12 20:46:10,210 INFO     CI: ConfidenceInterval(low=0.7522898042980868, high=0.8078006916173714)
2024-07-12 20:46:22,063 INFO     GPT-4 Logit Bias
2024-07-12 20:46:22,065 INFO     MCC: 0.8013199258613328
2024-07-12 20:46:22,065 INFO     CI: ConfidenceInterval(low=0.7736634701060949, high=0.826264710313134)
2024-07-12 20:46:33,614 INFO     GPT-4 Chain of Thought
2024-07-12 20:46:33,615 INFO     MCC: 0.7612698660956884
2024-07-12 20:46:33,615 INFO     CI: ConfidenceInterval(low=0.7343083038822843, high=0.7872060441990614)
2024-07-12 20:46:45,147 INFO     GPT-3.5 No Logit Bias
2024-07-12 20:46:45,149 INFO     MCC: 0.5721173279869864
2024-07-12 20:46:45,149 INFO     CI: ConfidenceInterval(low=0.5364120691623806, high=0.6049435815484477)
2024-07-12 20:46:56,751 INFO     GPT-3.5 Logit Bias
2024-07-12 20:46:56,752 INFO     MCC: 0.6153218890549007
2024-07-12 20:46:56,753 INFO     CI: ConfidenceInterval(low=0.5786026091904767, high=0.6496471826399669)
2024-07-12 20:47:08,237 INFO     GPT-3.5 Chain of Thought
2024-07-12 20:47:08,238 INFO     MCC: 0.555899829380609
2024-07-12 20:47:08,238 INFO     CI: ConfidenceInterval(low=0.5228469183251688, high=0.5867468486993338)
2024-07-12 20:47:19,837 INFO     Mistral 7B No Logit Bias
2024-07-12 20:47:19,838 INFO     MCC: 0.5557952155773076
2024-07-12 20:47:19,838 INFO     CI: ConfidenceInterval(low=0.5201094060052628, high=0.5902223079204123)
2024-07-12 20:47:31,372 INFO     Mistral 7B Logit Bias
2024-07-12 20:47:31,372 INFO     MCC: 0.5557952155773076
2024-07-12 20:47:31,372 INFO     CI: ConfidenceInterval(low=0.5201094060052628, high=0.5902223079204123)
2024-07-12 20:47:43,024 INFO     Mistral 7B Chain of Thought
2024-07-12 20:47:43,025 INFO     MCC: 0.5286849551836705
2024-07-12 20:47:43,025 INFO     CI: ConfidenceInterval(low=0.49092621197253544, high=0.5641579439821088)
2024-07-12 20:47:54,651 INFO     DeBERTa
2024-07-12 20:47:54,652 INFO     MCC: 0.6522230396893499
2024-07-12 20:47:54,652 INFO     CI: ConfidenceInterval(low=0.6176961816077478, high=0.6849706246917705)
2024-07-12 20:48:03,767 INFO     PoliBERTweet
2024-07-12 20:48:03,768 INFO     MCC: 0.678387299421241
2024-07-12 20:48:03,768 INFO     CI: ConfidenceInterval(low=0.6287926275067431, high=0.7255335006116116)
2024-07-12 20:48:12,770 INFO     BERTweet
2024-07-12 20:48:12,771 INFO     MCC: 0.6417142109204896
2024-07-12 20:48:12,771 INFO     CI: ConfidenceInterval(low=0.5913113461057378, high=0.6924383470376034)
2024-07-12 20:48:21,693 INFO     RoBERTa
2024-07-12 20:48:21,694 INFO     MCC: 0.589301603401602
2024-07-12 20:48:21,694 INFO     CI: ConfidenceInterval(low=0.5333743713436329, high=0.6413959542089173)
2024-07-12 20:48:21,718 INFO     ##### CIs for documents that do not mention Trump #####
2024-07-12 20:48:29,151 INFO     GPT-4 No Logit Bias
2024-07-12 20:48:29,152 INFO     MCC: 0.6563210103946051
2024-07-12 20:48:29,152 INFO     CI: ConfidenceInterval(low=0.5464933631452832, high=0.7494366413948221)
2024-07-12 20:48:36,451 INFO     GPT-4 Logit Bias
2024-07-12 20:48:36,452 INFO     MCC: 0.7403323542725594
2024-07-12 20:48:36,452 INFO     CI: ConfidenceInterval(low=0.6204500272108008, high=0.8311832327975659)
2024-07-12 20:48:43,717 INFO     GPT-4 Chain of Thought
2024-07-12 20:48:43,718 INFO     MCC: 0.6481138540018722
2024-07-12 20:48:43,718 INFO     CI: ConfidenceInterval(low=0.5106974567192181, high=0.7569602375675369)
2024-07-12 20:48:50,983 INFO     GPT-3.5 No Logit Bias
2024-07-12 20:48:50,984 INFO     MCC: 0.43762259956706706
2024-07-12 20:48:50,984 INFO     CI: ConfidenceInterval(low=0.2797400592772132, high=0.5667022983411486)
2024-07-12 20:48:58,271 INFO     GPT-3.5 Logit Bias
2024-07-12 20:48:58,272 INFO     MCC: 0.6104611356955602
2024-07-12 20:48:58,272 INFO     CI: ConfidenceInterval(low=0.4685045921118449, high=0.7255880252160128)
2024-07-12 20:49:05,690 INFO     GPT-3.5 Chain of Thought
2024-07-12 20:49:05,691 INFO     MCC: 0.5188856271409571
2024-07-12 20:49:05,691 INFO     CI: ConfidenceInterval(low=0.36799003609699366, high=0.6487145118755678)
2024-07-12 20:49:13,083 INFO     Mistral 7B No Logit Bias
2024-07-12 20:49:13,084 INFO     MCC: 0.5295276251720106
2024-07-12 20:49:13,084 INFO     CI: ConfidenceInterval(low=0.3794788378827252, high=0.6588408021714747)
2024-07-12 20:49:20,489 INFO     Mistral 7B Logit Bias
2024-07-12 20:49:20,490 INFO     MCC: 0.5295276251720106
2024-07-12 20:49:20,490 INFO     CI: ConfidenceInterval(low=0.3794788378827252, high=0.6588408021714747)
2024-07-12 20:49:28,046 INFO     Mistral 7B Chain of Thought
2024-07-12 20:49:28,047 INFO     MCC: 0.47605772876321106
2024-07-12 20:49:28,047 INFO     CI: ConfidenceInterval(low=0.3373789771209346, high=0.6009251805597777)
2024-07-12 20:49:35,388 INFO     DeBERTa
2024-07-12 20:49:35,388 INFO     MCC: 0.46190158434435463
2024-07-12 20:49:35,388 INFO     CI: ConfidenceInterval(low=0.30914307838775257, high=0.5988420316931224)
2024-07-12 20:49:42,729 INFO     PoliBERTweet
2024-07-12 20:49:42,730 INFO     MCC: 0.6130766722798889
2024-07-12 20:49:42,730 INFO     CI: ConfidenceInterval(low=0.47633014629217724, high=0.7278599736017346)
2024-07-12 20:49:50,028 INFO     BERTweet
2024-07-12 20:49:50,029 INFO     MCC: 0.48852128482359375
2024-07-12 20:49:50,029 INFO     CI: ConfidenceInterval(low=0.3421991760957742, high=0.6174466552414885)
2024-07-12 20:49:57,283 INFO     RoBERTa
2024-07-12 20:49:57,285 INFO     MCC: 0.5159718503509759
2024-07-12 20:49:57,285 INFO     CI: ConfidenceInterval(low=0.371566722124737, high=0.646107677051198)
